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ABSTRACT 


This thesis examines the relationships between independent 
variables such as underway time, material condition, and 
personnel manning and dependent variables in the form of 
engineering exam scores. Multinomial linear regression models 
are used to examine these relationships. These efforts met 
with limited success. The percent of time that a ship spends 
underway prior to an OPPE was the most significant of any 
independent variable considered, yet efforts to model the 
effects of diminishing returns were unsuccessful. Outchop 
OPPEs failed to show any significant relationship for the 
underway independent variables examined, but they did reveal 
that ships which file a greater number of CASREPs prior to 
receiving an outchop OPPE increase their odds of receiving a 
favorable test score. Attempts to model LOE were 


unsuccessful. 
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I. INTRODUCTION 


A. BACKGROUND 

The ability of a Navy ship to perform its peacetime and 
wartime missions is a function of its various departments' 
(Operations, weapons, engineering, navigation, and supply) 
abilities to conduct their individual tasks. The primary 
goals of the engineering department, providing propulsion, 
generating electricity, and controlling battle damage, are an 
intricate part of the ability of the ship as a whole to 
perform its mission. Consequently, the measurement of a 
ship's engineering readiness plays a role in the overall 
assessment of the ship's ability to complete its mission. 
To evaluate the engineering department of each conventionally 
powered surface ship, the Commander in Chief, Atlantic Fleet, 
established the Propulsion Examining Board. 

The Atlantic Fleet Propulsion Examining Board (PEB) 
consists of Naval officers with shipboard engineering 
experience. Headed by a post-command Captain, the board is 
divided into several inspection teams. Each examination team 
consists of a post-command Commander, as well as other 
officers with engineering experience at the department head 
and division officer levels. The head of the PEB is tasked 


with inspecting Atlantic Fleet ships using a uniform standard 


of engineering readiness. Since the board operates out of one 
office, with one clear set of standards, exam results may be 
viewed aS a good aggregate measure of a ship's engineering 
readiness. The PEB conducts two basic types of examinations, 
Operational Propulsion Plant Examinations (OPPE's) and Light 
Off Examinations (LOE'sS). 

The primary purpose of an LOE is to determine the ship's 
ability to safely operate the engineering plant equipment. 
Additionally, an LOE evaluates the ability of a ship to combat 
a flammable liquid fire in a main engineering space. LOE's 
are typically administered after an idle period of 120 days 
or more of the ship's engineering plant. Usually, such a 
period of inactivity occurs during a period of maintenance 
such aS a regular overhaul (ROH) or selected restricted 
availability (SRA). An LOE is also administered prior to the 
commissioning of a ship. 

On the other hand, OPPE's are administered to a ship in 
an operating status. The PEB conducts an OPPE for each ship 
approximately every 24 months. While an OPPE also evaluates 
the ship's abilities to safely operate propulsion plant 
equipment and to combat a flammable liquid fire, the focus of 
the exam is somewhat different. The PEB examines the ability 
of the ship to man a three section underway watchbill. It 
also determines the ability of the ship to conduct its own 


underway training and evaluation using in-house evaluation 


teams Known as the Engineering Casualty Control Training Team 
(ECCTT) and the Damage Control Training Team (DCTT). 

The OPPE and LOE are the best overall measures of a ship's 
engineering readiness. The examination criteria are the most 
comprehensive of any exam administered to surface units. The 
PEB compares current and past ship engineering procedures 
against prescribed fleet and type commander requirements. 
The PEB assigns qualitative grades to the exam results for 
both exams. Exams do not receive quantitative scores ona 
numeric scale, for example, zero to 100. Each exam receives 
an overall score which is a reflection of the results of 
various subareas such as the ship's material status, level of 
knowledge, training, firefighting, ability to operate 
equipment safely, and the like. The LOE's are evaluated on 
a pass-fail basis, while OPPE's receive relative scores such 
as above average, average, below average, and unsatisfactory. 

The material evaluation of the ship's engineering plant 
includes both a static and dynamic inspection. Prior to any 
other major portion of the inspection, the PEB evaluates the 
physical condition of the equipment. The crew provides an 
initial assessment which establishes that a specified minimum 
level of equipment is functioning. The PEB then requires 
selected equipment to be demonstrated as operational; for 
example, a qualified operator may be required to start a fire 


pump correctly and place it in operation. An evolution such 


as this also helps PEB to assess the level of knowledge of the 
engineering department. 

The PEB evaluates the level of knowledge of the department 
through the successful operation of plant equipment, as 
previously discussed. It also utilizes oral and written 
exams. The written exams arrive at the ship just prior to the 
exam. Critical watchstanders also undergo a formal board of 
oral examination. In addition, crew members are also subject 
to questioning by PEB members at any point during the exam. 

The engineering department's operating logs, legal, and 
administrative records are also inspected for proper format 
and recordkeeping. The administrative review helps to 
establish the ship's ability to implement required, safety- 
related programs. It also inspects the ability of the ship 
to conduct requisite watchstation training and follow up with 
the appropriate documentation. The review in these areas 
focuses on the ability of the ship to schedule personnel to 
attend required schools, to conduct required organizational 
training onboard, and to correctly record these events in the 
required manner. The PEB also inspects the ship's operating 
and legal records. This inspection provides additional 
insight into the material status of the equipment. It also 
demonstrates the ability of the crew to identify problem 
areas, for instance an out of tolerance temperature reading, 


and to take corrective action. However, the operating log 


inspection is but one technique available to PEB for the 
evaluation of proper casualty control procedures. 

Perhaps the most intense period of the exam occurs during 
the graded casualty control drills. During these drills, the 
ship's own casualty control training teams, ECCTT and DCTT, 
conduct casualty drills on various equipment. The PEB 
evaluates the ability of the shipboard team to impose, 
conduct, and evaluate these drills, as well as the ability of 
the crew to effectively handle the casualty. The PEB members 
constantly question and evaluate every level of watchstander - 
- from the commanding officer through the engineering officer 
of the watch to the lowest ranking fireman on duty in the 
engineering spaces -- to determine each individual's current 
assessment of the casualty, their required actions, and 
subsequent possible effects. The majority of the drills focus 
solely on the engineering department, but one area of 
evaluation, firefighting, concerns all hands. 

The PEB's assessment of firefighting focuses on the 
ability of the ship to combat a major fire in a main 
engineering space. A typical scenario involves the discovery 
of a major flammable liquid leak in a main engineering space. 
As the drill advances, the casualty becomes more complex, 
usually progressing into a main space fire. While engineering 
department personnel would typically combat such a fire, 


additional personnel are tasked to provide backup and 


support. The PEB will typically evaluate the qualifications 
and performance levels of these personnel as well. The main 
Space fire drill is one of the most difficult phases of the 
entire exam. 

The PEB administers the most comprehensive engineering 
examinations for surface ships. While other measures of 
readiness, such as casualty reporting procedures, may provide 
a more detailed static assessment, PEB provides the only 
uniform inspecting team which evaluates the current status and 
inspects the past operating procedures in an attempt to ensure 
safe engineering plant operation in the future. 

B. PURPOSE 

Since PEB administers exams on a fleet wide basis, 
examination results are of great interest to the other levels 
of the chain of command, such as squadron, group, and type 
commander, in addition to the ships themselves. While all 
levels strive for high engineering readiness as a goal, each 
attempts to specifically aid or prepare a ship for an upcoming 
exam. Perhaps the best example is that of the Commander Naval 
Surface Force Atlantic (CNSL) Engineering Mobile Training Team 
(EMTT) . This team conducts periodic and preliminary 
inspection visits on ships in an effort to make them better 
prepared for an OPPE or an LOE. The squadron or type 
commander may also schedule an additional maintenance period, 


or additional days underway for training, in the hope of 


achieving a higher score. In fact, CNSL maintains a shipboard 
training and readiness division, N6, which is tasked with 
monitoring ship engineering readiness and assisting ships in 
their preparation for engineering inspections. 

Both the type commander and the squadron commander support 
a ship's efforts to increase its score on an OPPE or LOE. 
Both staffs contain personnel intimately familiar with 
shipboard engineering requirements through their own 
experiences at the senior enlisted and officer level. With 
such a high level of interest focused on this one measure of 
effectiveness, the examination process becomes a natural topic 
for academic study. The Center for Naval Analysis (CNA) has 
conducted the majority of previous work is this area. 

Linda Cavalluzzo, a CNA analyst working at the request of 
CNSL, performed the initial study to interpret possible 
critical inputs into the exam scores [Ref. 1]. It focuses on 
the effect of an increased number of days underway for CNSL 
ships receiving an OPPE. Cavalluzzo uses a pass/fail 
criterion as her measure of effectiveness (MOE). While her 
results are promising (i.e., they indicate an increased chance 
of receiving a passing grade for those ships with a greater 
number of underway days), her study is limited to a small 
sample of ships (22) over a short period of time. The brevity 
of the analysis and small number of observations are no doubt 


the fallout of a timely requirement for the results. 


Alan Marcus™ et als also attempe “tomecvaludace = sence 
relationships between OPTEMPO, the number of days a ship 
spends underway, and readiness [Ref. 2]. The study is more 
comprehensive in nature, covering a greater number of ships 
(134) over a longer period of time (1982-1985). The study 
uses the results of a selected exercise (SELEX) in navigation, 
the ability of individual shipboard departments to win 
competitive awards, as well as OPPE results as the primary 
MOEs. Marcus also chooses the pass/fail criterion as the 
primary OPPE MOE, thus combining a possible four or five 
choices into two distinct categories. He also focuses the 
majority of his analysis on one critical input factor -- 
OPTEMPO. Marcus utilizes a similar rationale for review as 
did Cavalluzzo, yet he concludes that the pass rate for an 
OPPE had no association with OPTEMPO. This sets the stage for 
the current analysis. 

This thesis builds on the work of Marcus and Cavalluzzo 
in an attempt to discover a resources-to-readiness 
relationship between various critical input factors and their 
effect on OPPE and LOE exam scores. Previous work has focused 
primarily on OPTEMPO as an important factor. This thesis will 
consider a broader scope of inputs, such as_ various 
measurements of material readiness as well as the level of 
manning. It will also evaluate the level of detail provided 


by the exam results -- resisting the temptation to utilize a 


Simple pass/fail criterion -- and will rely instead on the 
greater qualitative distinction provided by the exam scores. 

By broadening the scope of study in the number of exams 
reviewed, possible input factors considered, and_ the 
assessment of output measures, this thesis seeks to determine 
relationships that decision makers may use in assessing 


various input factors and their effects on ship exam scores. 


II. DATA AND SOURCES 


A. INPUT DATA 
As with the previous studies this effort utilizes data 

from a CNA database. The database contains data on 152 
surface ships from fiscal year FY 1978 through FY 1988. The 
variables reflect monthly measures of their respective 
quantities, with the exception of several manpower variables, 
which due to CNA computation reflect 90 or 180 day values. 
The data originate from a number of different sources, most 
of which are primary monitoring or decision making tools for 
the Navy or Department of Defense. Initially compiled in 
response to a CNA effort concerning the factors affecting ship 
material condition, the variables cover a wide range of 
topics. Reference 3 describes these sources in depth. In 
part, the sources include the following: 

- Ship Employment History (SEH) 

- Officer Master Files 


- Defense Manpower Data Center's Enlisted Personnel 
Unit Identification Code File 


- Enlisted Master Record Files 

- Enlisted Billet Files 

- Board of Inspection and Survey 
- 3-M Maintenance Data System 


- 3-M Parts Records 
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- Casualty Reporting System (CASREPs) 
~ Ship Fuel and Steaming Hours Data 

In general, the data fall into one of three basic 
categories based on the quantities which they describe: 
material condition of the ship, manpower, or underway time. 

The CNA database contains several useful measures of each 
ship's underway time. The variables which describe the 
percent underway and the percent in port each month are the 
most simple and direct measure. When they are added together, 
they sum to 100.00. Another variable contains the number of 
hours steaming underway in a month. Its companion contains 
the number of hours steaming not underway in a month. This 
measure allows analysis in the scenario where a ship operates 
the engineering plant tied to the pier or at anchorage. Other 
underway variables include the percent deployed, the percent 
long deployment (i.e., when a ship is on duty in the Western 
Pacific, Indian Ocean, or Persian Gulf), and the percent of 
extended operations (greater than eight weeks away from 
homeport). 

Several related measures of manpower are also present in 
the database. Manpower variables divide easily into two 
different types: those which describe the current level of 
manning relative to the prescribed level and those which 


measure the rate of crew turnover. 
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The measures of crew turnover are for 90 (one quarter) and 
180 day (two quarters, or six months) periods. Values 
available include the percent new crew overall, which applies 
to all enlisted personnel job specialties, or ratings, and the 
percent new crew in the engineering job ratings. 

The variables which describe the manning level relative 
to requirements also display values for both the entire crew 
and engineering ratings. The CNA data use two weights in the 
computation of these ratios. The first weight utilizes only 
the difference in pay among enlisted personnel. The second 
attempts to capture differences in the productivity of 
enlisted personnel based on their paygrade. The weighting 
scheme is the result of CNA follow up work on a Rand 
Corporation study. Appendix D of Reference 3 contains 
additional details. The numerator values of these ratios, the 
manning levels, are also available for study. 

Manning values are subdivided into three paygrade groups. 
Manning to requirements measures exist for paygrades of junior 
personnel (E1-E3), mid-grade petty officers (E4-E6), and 
senior petty officers (E7-E9) for the overall crew. A measure 
of this ratio is also available for mid-grade engineering 
petty officers (E4-E6). 

The final input variables available for study are those 
which describe the material condition of the ship. All of 


these measures utilize Casualty Reporting (CASREP) data. A 


a 


CASREP is a message sent from the Commanding Officer of a ship 
to his administrative and operational commanders describing 
equipment which is not functioning as designed. These 
messages document discrepancies which cannot be repaired 
within 48 hours after discovery. Three categories exist to 
describe the degree of degradation, C2, C3, and C4, in 
increaSing order of seriousness. 

All of the data present describing material readiness 
prior to exams in the CNA database utilize measures derived 
from CASREPs. All values meaSure monthly events. The first 
variable measures the number of CASREPs which begin:in a given 
month by degree of degradation. One value also exists which 
describes the number of C3 and C4 CASREPs which begin in a 
given month; it is the sum of the individual measures. A 
variable also exists which describes the number of days a ship 
spends ina C3 status in the month. For example, if a ship 
has two C3 CASREPs for a 30 day period, this value would be 
60. Again, an aggregate measure exists for the C3 and C4 
status combined. Finally, variables exist to describe the 
number of days that a ship is free of CASREPs. These values 
range from 0 to 31, with the exception of the aggregate 
measure, Days Free of C3/C4 CASREPs. This measure has values 
in the range from 0 to 62. 

At least one caveat is important to note in the material 


measures at this juncture. The CASREP data, while accurately 


a3 


describing the material condition of the ship, includes 
casualties from other areas of the ship. Consequently, a 
casualty from the combat systems department will affect 
variable values, yet may be insignificant in the ability of 
the ship to pass an engineering exam. 

One shortfall exists in the overall database, a result of 
the past focus of CNA studies. In general, auxiliary ships 
(such aS ammunition ships, oilers, and food carrying ships) 
and amphibious ships (such as helicopter assault ships and 
tank landing ships) lack a complete set of input variables for 
study. This is the result of CNA studies which center on 
combatants. However, due to several CNA projects concerning 
manpower, the majority of the manpower-related input variables 
are present for all ships. The initial effect of this 
discovery requires more careful procedures when processing the 
data, and the ultimate impact is to restrict the range of 
ships to which possible conclusions apply. 

In summary, the CNA database contains accurate measures 
which have previously been used for modeling and analysis. 
While the data were initially used for a CNA study, they have 
been expanded and updated to cover additional areas of 


interest. 
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B. OUTPUT DATA 

Output data are primary source data. They come directly 
from the PEB. The data describe the results of every type of 
exam administered by the PEB. As previously discussed, the 
PEB gives two basic types of exams, OPPES and LOEs. Their 
database distinguishes some differences among these two types, 
however. For example, the results differentiate between the 
exams and reexams. Since the majority of reexaminations occur 
shortly after the initial evaluation date, the input variables 
are not noticeably different. Also, the PEB' usually 
reinspects only those failing areas of the initial exam. For 
these reasons, reexams are not reviewed in this study. rt 
also distinguishes between regular OPPES and OPPES given on 
the way home from a major deployment. The latter type of 
exam is called an outchop OPPE. The data also break out exams 
administered by the Atlantic Fleet Training Group (FTG) in 
Guantonomo Bay, Cuba. Since this specific type of exam is no 
longer administered, it is not considered in this review. 

Basically, the PEB data consist of the exam results, both 
the overall score and every subarea. It also contains 
ancillary information such as_ the - ship's’ homeport, 
administrative squadron assignment, etc. As previously 
discussed, the PEB assigns qualitative grades such as 
unsatisfactory, below average, average, and above average to 


OPPE exam results, and evaluates LOES on a pass/fail basis. 
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The PEB also records incomplete exams and the portions of 
exams which are not given. This policy results in a 
comprehensive data collection mechanism. While the majority 
of the PEB data concern output measures, three input variables 
are also present. 

The PEB database denotes the experience level of the 
engineering officer by showing the number of months which he 
has been in his current job. It reflects the experience level 
of the Commanding Officer (CO) in the same manner. The PEB 
also records if the CO was an engineer when he served as a 
department head. All of these factors contribute to the level 
of managerial expertise on board prior to the exam. 

In summary, the PEB database contains the exam results 
collected by the examination teams. With a Commander 
verifying the results prior to release, and one officer 
managing the database, the data are very accurate. The PEB 
data were matched to the CNA data and uploaded into the Naval 
Postgraduate School (NPS) mainframe computer for processing. 


A discussion of the methodology follows. 


IS 


III. METHODOLOGY 


As stated in the introduction, this thesis examines the 
resource-to-readiness relationships between input factors, or 
independent variables, and engineering exam scores, or 
dependent variables. Traditional approaches which search for 
a relationship between independent and dependent variables 
often utilize simple linear regression. However, due to the 
structure of the problem under study, and the assumptions of 
linear regression, this technique is inappropriate. A related 
procedure, called logistic regression, is the effective 
amalytical tool for the job. The following section will 
demonstrate the suitability of logistic regression, after 
describing the shortfalls of linear regression. 

Consider a simple linear regression model of an exam which 
assigns pass/fail scores. Linear regression uses the equation 
5 eae an Si) > aa al = 
for i= i1,...,N, where y, 1S a random variable which takes on 
the value of 1 if ship i passes the exam and O if it fails, 
a and b are unknown parameters, x, 1s the input factor under 
consideration, and e, is a random disturbance which is assumed 
to be normally distributed with a mean of zero and a variance 
of o¢ for all i. Let P. be the probability that y; = 1, and 
fete (ie-——P)) De themprobability Chat y, = 0. Note that if 


1 


fe | meer cen Ey.) = Pp, “=a + bx.. This approach 


a) 


immediately generates a number of problems. Note that while 
Y, is restricted to 0 or 91, Eheeyorenadtic sport icmm a -1- 
right hand side of the equation may take on any value. 
Consequently, e. can have only two values, -(a + bx,) and 1- 
(a + bx se Itvassumes these values with probabi laitrvessoeeia= 
(a + bx,) and -(a + bx.), respectively. Since a + bx. can have 
values greater than one or@iless than zeroj7eP. canvaleogbeslca. 
than O or greater than 1. These glaring contradictions are 
further compounded by the» varlance got ee The Cuadaieieaal 
assumption that Var(e.) = o* for all i no longer applies. 
instead, the Bernoulli @eharacter jofmy. requimes Sehamaeae 
variance fer e. become (a + bx; a - bx) eee Notice™@ehac 
the variance of e, now depends on i. This violates of one of 
the basic assumptions of simple linear regression that the 
variance of e, is the same for all 1. Finally, computations 
fons BiGyaioes) may result in values outside of the specified 
range of [0,1]. Judge et al. [Ref.5]} discuss these and other 
shortfalls of using linear regression to model this scenario. 

Since the simple linear model fails to correctly depict 
the basic pass/fail exam outcome, the binary logit is 
considered [Ref.6]. The binary logit model utilizes a linear 


regression model of the following form 
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where Y, 1s mot observed. It is called a “latent” variable. 
The value actually observed is a dummy variable y, where 
eat y > 0 


\ ie 
0 otherwise. 


The term x,, represents the value of the j™ independent 
variable for the it observation. The vector B, where 
jJ=1,...,S, 1S a vector of coefficients assigning various 
weights to the input variables. Note that in this model, 
unlike the previous one, E[y,|x;] is not B, + B,x,,, rather 


these terms represent the expected value of the latent 


variable vee The previous two relationships allow us to state 


S 
P, = Puob(y, = 1 ) = Buob[ u, > -( B, + LB;X;, aa 
j=l 
S 
ee le (Be B;X;;) ] 
ea 
where F is the cumulative distribution of u. Using the 
assumption that the distribution of u is symmetric (i.e., 1- 
F(-Z) = F(Z)), the equation takes the form 
S 
Py oe ( 3B, 2B Xi; Vee 
ie 


The functional form of this equation depends on the 
assumptions concerning the error term u. If the cumulative 


distribution of u, is logistic, then 


1, 


(Z;) S 
EZ.) re nere 2) — eee 2 eee 
] +eexpa@z-) jJ=1 


Further, we obtain 


F(Z;) 
leg ———— =42,, 
1 - F(Z,) 


and in terms of the model under discussion 


5 
log ——— = B+d BX). 


The left-hand side of the equation, known as the log-odds 
ratio, describes the effects of increasing or decreasing the 
explanatory variables on the logarithm of the odds of success. 


Consequently, the binary choice logit model has the final 


£orm 
S 

Shen sie mS B;x;; ) 

J=1 

ea 

S 
1 + excel e ee Bx; ) 

jJ=1 


This form is adequate for the pass/fail case. Clearly, a more 


complex model is required for the case where more than one 
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discrete output is possible. An extension of the previous 
model is an appropriate choice. 

The OPPE results consist of a qualitative response in the 
form of discrete scores. A Rand Corporation study [{Ref. 7], 
discusses such a structure, where the response variables are 
categorical. Let y, denote an assigned score for ship i, 
where 1= 1,...,N. Then let 


* 


ae eye a;} 


h 


where the response variable, exam score, for the i‘ ship can 


Q Meo 
Ae Note that 4=1 Pi; = jl. This 


ship must, in fact, receive one of the 


assume Q values, a,,...,a 


requires that the i‘ 


possible scores. The response variables are related to the 
input, or stimulus, variables by the standardized multivariate 


logistic CDF, which is defined by 


Pe | eR CS ED, 
lt exp ( ~t; ) 
a=) 

Defining t; immee rns Of | Zameandisapils nGeehtice di strabuielonesto 
the proposed model yields 
exp( 2;; ) | | 
P.. = ———__,,, i-l,...,N; j=1,.-..,Q. 

Q 


exp( 2, ) 
k=1 


Ze 


Define 2 re EF where X, 1S a 9S@x 1 Vector ofm@amput 
characteristics for ship 1. B; is the vector, S x 1 of the 
coefficient weights to be estimated. The coefficients may be 
estimated via a weighted least squares technique or a maximum 
likelihood estimation (MLE) technique. Until recently, the 
former was utilized. This is primarily the result of the time 
required to implement the latter on a computer; however, the 
software package which supports this thesis, Time Series 
Processor (TSP), uses MLE techniques. 

Once the computer generates an estimate for the 
coefficient, it is time to assess its significance. A "t- 
test" is conducted to determine if the given estimate is 
Significantly different from zero, implying a relationship 
between the input factor and exam _ score. Since the 
coefficient estimates are MLE's and the estimated standard 
errors are the square roots of the diagonal elements of the 
asymptotic variance-covariance matrix, which iS derived from 
the Cramer-Rao lower bound, this is an asymptotic t-test. The 
value of the t-statistic is the estimate of the coefficient 
divided by the standard error [Ref. 6]. In most cases, the 
Sign of the coefficient is known prior to computation. For 
instance, an increase in the number of days free of CASREPs 
would have a positive impact on the exam score. Consequently, 
a one sided "t-test" is performed; otherwise, when the sign 


of the estimated coefficient is unknown, a two-sided test is 


ee 


used. “Througheut the course of analysis, the actual value of 
the t-statistic will be presented to avoid disputes concerning 


the appropriate level of significance. 
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IV. PROPOSED MODELS 


As discussed during the review of the data, available 
input factors fall into one of three broad categories: 
manpower, underway time, or material condition. The data 
collection techniques used in assembling the database result 
in the variables having a high degree of collinearity within 
each category. Consider, for example, those variables 
measuring a ship's material condition. All of the measures 
are based on the CASREP system. The number of days a ship 
spends in a C3 status is simply the number of days in the 
month minus the number of days it spends free of C3 CASREPs. 
In a similar manner, the number of CASREPs which begin in a 
month's time influences the number of days a ship spends in 
a casualty status. Consequently, it is important to determine 
which variable within each category makes the greatest impact 
on the exam score. 

The simplest way to approximate which variable has the 
greatest significance is to conduct several univariate runs. 
The sign of the estimated coefficient is not the critical 
issue, since it is usually known prior to the run. The 
magnitude of the estimate and the associated significance is 
what counts. A value of zero for the coefficient would imply 


no relationship between the independent and dependent 
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variables. TSP presents the estimated coefficient, standard 
error, and t-statistic for review on the print out. The value 
of the t-statistic is the key to evaluating the importance of 
the estimate. 

Once the most significant variable in each category is 
determined, multivariate models may be approximated using the 
most significant variables from the univariate analysis. 
The OPPE scores are a function of the underway time, manpower 
status, and material condition. These values are used by TSP 
in the x vector, as discussed in the previous section. The 
B vector contains the values of the estimated coefficients. 

The LOE model uses the multinomial logit formulation as 
well, since the multinomial reduces to the binomial case when 
there are only two possible choices. The LOE scores are a 
function of both the manpower status and material condition 
of the test ship. Since LOE's occur after a ship has not 
been underway for at least 120 days, underway time is not 
considered for this model. The ability of a ship's material 


Sieaqtus to influence LOE scores also becomes a concern at eirs 


point. Recall that all material measures are based on the 
CASREP system. When a ship enters an overhaul period, the 
reporting procedures for casualties change. This allows 


shipyard workers to repair and replace equipment without a 
CASREP being filed. In view of this new concern about the 


ability of material variables taken in combination with 


Zo 


earlier remarks concerning the utility of the material 
variable as a whole, the value of this measure 1S in some 
doubt. But since overhaul periods comprise only one type of 
event which precedes an LOE, the CASREP measure may still have 


some validity. 
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V. ANALYSIS 


A. UNIVARIATE MODELS 

TSP presents estimated coefficients for review in tabular 
form. Since the software normalizes the estimated 
coefficients, the value for the lowest coefficient is set to 
zero. For the LOE, where the exams are reported as a pass or 
fail, the effect is to estimate the coefficients reflecting 
the constant term and the log odds of passing the exam. For 
the OPPE, the coefficient for the log odds of receiving a 
failing score is set to zero. Since the focus of this thesis 
is to determine important input factors which result in ships 
successfully completing these exams, this development is not 
a significant shortcoming. 

Recall that the majority of the data are available in 
monthly values. Runs were conducted varying the number of 
months in the independent value from one to six. Usually, 
when the three months or six months previous to the month in 
which the exam was given were used as the input value, the 
most significant results were achieved. Consequently, one or 
two quarters prior to the month of the exam is used most often 
for the independent variable values. This is also in keeping 
with the planning and scheduling timeframes utilized by the 


Navy. 
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1. Material Variables 

As previously discussed, univariate runs7~ were 
conducted using the LOE, OPPE, and outchop OPPE as output 
measures across all three variable types to determine which 
variable from each of the three categories is the most 
Significant. Material variables were considered first. When 
examining the effects of CASREP status on OPPE scores, it is 
logical to assume that those values which measure more severe 
degradations would have a greater impact on the examination 
score. Univariate runs using material measures of readiness 
Support this assumption. The Days Free of C3/C4 CASREPs in 
the quarter prior to the month of the exam (DF34-90) is the 
most significant material variable for the regular OPPE. As 
shown in Table 1, all of the signs of the slope coefficients 
are positive as anticipated. This implies that more days free 
of C3/C4 CASREPs increase the log odds of receiving a passing 
score (1.e., below average, average, or above average). The 
estimated slope coefficient for those ships receiving above 
average scores is greater than the other estimates. Its t- 
statistic value is also the greatest, giving it a level of 
Significance of less than 0.05. This implies that there is 
less than a five percent chance of error when stating that of 
the ships receiving an OPPE, an increase in the number of days 
free of C3/C4 CASREPs increases the log odds of attaining that 


score. The other estimated coefficients have a level of 
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TABLE 1. OPPE vs. DF34-90 (Degrees of Freedom = 277) 
ee 


Parameter Estimate T-Statistic 


Below Average 


Constant Or O24 2o =1.0e3 cam! 
DF34-90 0.006690118 0265292256 
Average 

Constant pO. LIS9808 =O. 206819 
DF34-90 07006795538 0.7839620 
Above Average 

Constant -3.120854 me. OL1LO097 
DF34-90 0.02949016 Die O.3.0 3k 


*significant at the .05 level 


Significance greater than 0.20, but they are not significant 
at the 0.05 level. 

Ships receive outchop OPPEs at the end of the 
deployment enroute to homeport. A ship has usually been away 
from homeport for a period of approximately six months. While 
the Navy endeavors to give increased support to deployed 
units, the maintenance patterns differ from a non-deployed 
status. For instance, parts support is more difficult. While 
stores ships carry spare parts for deployed ships, their 
Capacities are limited. Also, when a ship is away from its 
homeport on deployment, it does not have access to the local 
Navy Supply Center or local civilian suppliers. Consequently, 
shipboard patterns for CASREPs change during a deployment, 


perhaps in an attempt to prompt the supply system for needed 
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parts. This causes the most important material measure to be 
different for outchop OPPEs than for regular OPPES. The most 
Significant material measure affecting outchop OPPE scores is 
the number of C4 CASREPs which begin in each month for the six 
months prior to the month of the exam (BC4-180). As shown in 
Table 2, the sign of the estimated slope coefficient is 
certainly not as expected. In short, it says that ships which 


TABLE 2. OUTCHOP OPPE vs. BC4-180 


(Degrees of Freedom = 72) 
SSS SSS _ Se ———————————————— S  — —————ESESESxrEEEEEE—_EL—EE-E-EESS 


Parameter Estimate TW=Statirst ire 


Below Average 


Constant ge itS) 7 OMS eas’ See SS 7a 
BC4-180 0.4040139 2.455777%** 
Average 

Constant -0.6774675 =). o2eose 
BC4-180 O-507086) 2.001085% 
Above Average 

Constant -1.788364 —S3). 3922 e 
BC4-180 0.4261859 2.482655%** 


* Significant at the 0.05 level 
xk Significant at the 0.025 level 


file more C4 CASREPS in the six months prior to the month of 
the exam have an increase in the log odds of receiving a 
passing score. This shipboard strategy is not unexpected in 
general, since it is sometimes employed in an attempt to 


expedite parts or assistance prior to the start of a 
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deployment; however, it is surprising that it surfaces in this 
instance which occurs near the end of a deployment. The t- 
statistic value is significant at the 0.05 level, and the 
magnitude of the estimated coefficients are the greatest seen 
thus far. 

Material measures also influence the LOE scores. 
Recall that ships receiving an LOE either pass or fail the 
exam. The LOEsS are affected most by the number of days of 
C3/C4 CASREPs in the two quarters prior to the month of the 
exam (CD34-180), as shown in Table 3. The sign of the 
coefficient is negative as anticipated, indicating that an 
increase in the number of days of C3/C4 CASREPs has a negative 


TABLE 3. LOE vs. CD34-180 (Degrees of Freedom = 96) 


Parameter Estimate T-Statistic 
Passing 

Constant 2./94936 1.265409 
CD34-180 -0.05296375 -1.204150%* 


* Significant at the 0.10 level 


impact on achieving a pasSing score. The magnitude of the 
estimated coefficient and its level of significance are less 
than for previous input factors considered. 
2. Underway Time Variables 
Those variables which measure the amount of time a 


ship spends underway are the next category for discussion. 
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Recall that since an LOE is administered after a prolonged 
inport status, it is not discussed here. As shown in Table 
4, the variable which measures the percent of time a ship is 
underway in the six months prior to the month of the exam 
(PRUW-180) has the greatest impact on the OPPE exam scores. 
Unlike the CASREP variables, which were the most significant 
for the quarter before the exam, it appears that underway time 


TABLE 4. OPPE vs. PRUW-180 (Degrees of Freedom = 277) 


Parameter Estimate T-Statistic 


Below Average 


Constant -1.430346 m2 4.3820 
PRUW-180 0.006204640 1.847222* 
Average 

Constant =-l. 1863894 =2.029214 
PRUW-180 0.008172133 2.762979%*%* 
Above Average 

Constant =-3.429899 —-3~.416572 
PRUW-180 0.0112234% 2.493490%* 


* Significant at the 0.05 level 
** Significant at the 0.01 level 


has the most impact for the six months, or two quarters, prior 
to the exam. Again, the signs of the estimated slope 
coefficients are positive as anticipated, implying that a 
higher percentage of time underway is beneficial in the six 
months prior to the month in which the exam is given. The t- 


statistic values for the estimated coefficients are all 


Se 


srgnifticant . The least significant has a level of 
Significance of less than 0.05. 

The percent of time spent underway in the three months 
prior to the exam (PRUW-90) is the most significant underway 
measure for outchop OPPEs. The signs of the estimated slope 
coefficients in Table 5 are positive, as anticipated. Both 
the coefficient and the t-statistic value are the greatest for 
the average test score, implying that an increase in the 
percent of time underway had the greatest impact in achieving 
this score. The lowest t-statistic value occurs for the above 
average score, and with a level of significance of less than 
ran Or. 


TABLE 5. OUTCHOP OPPE vs. PRUW-90 (Degrees of Freedom = 71) 


Parameter Estimate T-Statistic 


Below Average 


Constant -1.4017210 -2.443562 
PRUW-90 0.006307510 1 597810* 
Average 

Constant -0.94444166 =i, 9.54540 3 
PRUW-90 0.006826114 2.014881** 
Above Average 

Constant eG 1G 2 -2.541660 
PRUW-90 0; 005502330 1.288903% 


* Significant at the 0.10 level 
*x Significant at the 0.05 level 
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3. Crew Manning Variables 

Variables which reflect crew manning also play a role 
in influencing exam scores. The percent of turnover in 
enlisted personnel in the engineering department in the 
quarter prior to the month of the exam is the most important 
factor for OPPEs (PNE3-90). As shown in Table 6, the signs 
of the estimated slope coefficients are negative as expected, 


TABLE 6. OPPE vs. PNE3-90 (Degrees of Freedom = 277) 


Parameter Estimate T-Statistic 


Below Average 


Constant —02 2929169 =O? 2.5 Ol 
PNE3-90 —-O70@53819893 —Ooo42 506 
Average 

Constant OVGowy 273 2.295294 
PNE3-90 -0.01693883 -1. /83365% 
Above Average 

Constant = 063960 = 2 2 oO 
PNE3=-90 —0 01160226 —-0.73 L86380 


* Significant at the 0.05 level 





implying that an increase in the rate of personnel turnover 
in the engineering department decreases the log odds of 
receiving that score. Only the estimated slope coefficient 
for an average test score is Significant at the 0.05 level. 

Variables which describe the crew manning for the 
months prior to an outchop OPPE produce some interesting 


results. Both the percent of new engineering department 
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personnel in the quarter prior to the month of the exam (PNE3- 
90), and the level of manning of midgrade petty officers 
shipwide for the quarter prior to the exam (M46R-90) impact 
on outchop OPPE scores. They are both presented here to 
indicate their relatively equivalent level of significance and 
to justify the variable chosen for incorporation in the 
multivariate outchop OPPE model. 

The PNE3-90 has a significant impact on the scores as 


shown in Table 7; however, the sign is the opposite of that 


TABLE 7. Outchop OPPE vs. PNE3-90 (Degrees of Freedom = 71) 


Parameter Estimate T-Statistic 


Below Average 


Constant -2.818458 -2.522146 
PNE3-90 Ve USsOcua? 2.048857* 
Average 

Constant =1).492497 -1.719659 
PNE3-90 G205407537 1.591466* 
Above Average 

Constant = 3.28 20 5a =—2 O02 nno7 
PNE3-90 0.09071160 2.037764** 


* Significant at the 0.10 level 
xk Significant at the 0.05 level 


which was expected. It is positive, implying that an 
increased rate of personnel turnover prior to an exam is 


beneficial. This is a counterintuitive result. No known 
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cause would produce this outcome. Like CASREP patterns, 
personnel turnover patterns are different during a deployment. 
Shipboard personnel tend to transfer at a greater rate before 
or after a deployment vice during a deployment. So while the 
values of the t-statistics are significant for all estimated 
coefficients at a minimum of the 0.10 level, the resulting 
reversal in the signs of the estimated slope coefficients make 
PNE3-90 inappropriate for consideration for the multivariate 
model. 

The M46R-90 also plays ae significant role in 
influencing the scores for outchop OPPES as shown in Table 8. 


The signs of the estimated coefficients are positive as 


TABLE 8. OUTCHOP OPPE vs. M46R-90 
(Degrees of Freedom = 71) 


Parameter Estimate T-Statistic 


Below Average 


Constant =F. 1 OS 2a © =2.69r1422 
M46R-90 0,0349227s 2.468589%* 
Average 

Constant =5. s330Ce7 -1.881447 
M46R-90 @.0 2 O 208A 1.825406% 
Above Average 

Constant Bl OO L OVS iS) sa ig i aes 
M46R-90 0202357663 1.639826% 


* Significant at the 0.05 level 
** Significant at the 0.025 level 
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anticipated, implying that a higher level of manning is 
better. The t-statistic values indicate that all the 
estimated coefficients are significantly different from zero 
at less than the 0.05 level. Since this measure of manning 
influence is more in line with expectations, and since no 
apparent explanation for the sign reversal can be found for 
the percent turnover measure, the former is’ chosen for 
inclusion in the multivariate model. 

Personnel manning also affects the outcome of LOEs. 
Both the amount of engineering crew turnover in the six months 
prior to the month of the exam (PNE6-180) and the level of 
manning shipwide for the junior enlisted personnel, E1-E3, for 
the month prior to the month of the exam (M13R-90) impact LOE 
scores. They are both presented in discussion here to review 
their relative level of significance and to justify the one 
selected for inclusion in the multivariate model. 

Table 9 displays the effects of PNE6-180 on LOE 
scores. The sign of the estimated coefficient is negative, as 
anticipated, implying that a higher rate of crew turnover 
decreases the odds of receiving a passing score. 

The M13R-90 also has an impact on the log odds of 
achieving a passing LOE score, as shown in Table 10. The sign 
of the estimated slope coefficient is positive, implying that 
a higher rate of manning is better. It is interesting to note 


that the t-statistic value 1s greater for M13R-90 than for 


Si / 


TABLE 9. LOE vs. PNE6-180 (Degrees of Freedom = 96) 
= 


Parameter Estimate T-Statistic 
Passing 

Constant 1.863670 4.386748 
PNE6-180 ~0.004528640 ~1.733043* 


* Significant at the 0.05 level 


TABLE 10. LOE vs. M13R-90 (Degrees of Freedom = 97) 
eee EEE ___ 


Parameter Estimate T-Statistic 
Passing 

Constant ~1.286832 ~1.153997 
M13R-90 0.02682330 2.223840* 


* Significant at the 0.025 level 


PNE6-180, even though the input variable is only for the month 
prior to the month of the exam vice the six months prior. The 
Significance level for M13R-90 is less than 0.025. The 
absolute magnitude of the estimated slope coefficient is also 
much greater for M13R-90s than for PNE6-1307— cy cnmthougnacne 
latter measures the rate of crew turnover specifically in the 
engineering department. For these reasons, M13R-30 is the 


measure incorporated into the multivariate LOE model. 





B. MULTIVARIATE MODELS 
Multivariate models are formed using the most significant 
variables from the univariate runs. The goal is to use those 


measures which have already demonstrated a relationship to 


capture the interactions which may occur among the input 


variables. These attempts met with little success. The 

multivariate model for the OPPE uses DF34-90, PRUW-180, and 

PNE3-90, in Table 11. Like the univariate models, the 
TABLE 11. OPPE vs. DF34-90/PRUW-180/PNE3-90 


(Degrees of Freedom = 134) 
Eo ———————_— _ ————___—__ 


Parameter Estimate T-Statistic 
Below Average 

Constant —1 2459331 -1.873792 
DF34-90 -0.0009838671 -0.1187338 
PRUW-180 0.006435732 1.876532* 
PNE3-90 0.0003021655 Ome 5 28762 
Average 

Constant -0.7600887 -1.044490 
DF34-90 -0.001248508 -0.1738605 
PRUW-180 0.008181062 2.744023 *x** 
PNE3-90 -0.01382492 -1.111305 
Above Average 

Constant -5.146638 =o oo 3 135 
DF34-90 0.02929889 35578 / * 
PRUW-180 0.01007018 Pela 3aw | ** 
PNE3-90 0.0000682056 0.04564056 


*x* 
K*k* 


Significant at the 0.05 level 
Significant at the 0.025 level 
Significant at the 0.01 level 
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value is so low as to make them insignificant. The importance 
of percent time underway is underscored by this model. In 
fact, it clearly dominates the other input factors. Yet, the 
estimated slope coefficients are not very great in magnitude. 

Attempts to form a significant multivariate model for 
outchop OPPEs met with similar results as shown in Table 12. 
The model uses BC4-180, PRUW-180, and M46R-90 as independent 
variables. Like the univariate manpower model for outchop 
OPPES which also uses M46R-90, the significance of the 
estimated slope coefficients for the manpower measures are low 
with the exception of the below average score. The signs of 
the estimated coefficients are positive. This implies that 
an increase in the level of manning has a positive, albeit 
small, impact on below average exam scores. Also, note the 
relative insignificance of the percent time underway as an 
input factor. This is the opposite of the regular OPPE, where 
it was important. Perhaps this is a result of the outchop 
OPPE being given at the end of a deployment where all ships 
would normally have a higher operating tempo, reducing the 
impact of individual differences on exam scores. The 
magnitude of the estimated coefficients is higher than 
previous models for BC4-180, indicating, as in the univariate 
outchop OPPE model, that ships which file more casualty 
reports in the six months prior to the exam increase the log 


odds of achieving a passing score. 
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TABLE 12.: OUTCHOP OPPE vs. BC4-180/PRUW-180/M46R-90 
(Degrees of Freedom = 47) 
a 0 


Parameter Estimate P-Value 


Below Average 


Constant awd 2 37920 ~1.864744 
BC4-180 0.4134871 1.946976* 
PRUW-180 Om 2257835 -0.3016684 
M46R-90 0.04615580 1.779475* 
Average 

Constant -4.081422 On G7 SORiG 
BC4-180 0.2322206 229952 
PRUW-180 0.004349979 0.6688791 
M46R-90 0.007969758 OessoS083 
Above Average 

Constant 022036105 0.0325641 
BC4-180 0.3560169 1.674598* 
PRUW-180 -0.009437287 See 4 1 37 
M46R-90 0.00463012 0.1889376 


* Significant at the 0.05 level 


The multivariate LOE model met with poor results as shown 
ijjetable 13. It uses CD34-180 and M13R-30 as independent 
variables. 

TABLE 13. LOE vs. CD34-180/M13R-90 


(Degrees of Freedom = 96) 
a 


Parameter Estimate T-Statistic 
Passing 

Constant O273:8 7.126 0.7810106 
CD34-180 -0.002938007 -0.3680441 
M13R-30 0.001935358 0.5478099 
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Again, the motivation for the selection of these variables 
and their respective times rests with the univariate model. 
The model calculates the signs of the estimated slope 
coefficients as negative and positive respectively. This 
implies that fewer C3/C4 CASREPs and junior enlisted higher 
manning are better. Yet, the value of the t-statistics are 


so low as to make them insignificant. 
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VI. CONCLUSIONS 


This thesis set out to confirm relationships between input 
measures of manpower, underway time, and material readiness, 
and their impact on LOE and OPPE exam scores. By broadening 
the measure of performance to reflect the level of detail 
recorded by the PEB, the models attempt to capture these 
effects via multinomial logistic regression using a software 
package called TSP. These efforts met with limited success. 

The analysis effort involved using independent variables 
from the CNA ship database. The majority of ships considered 
had complete manpower variables a result of past CNA study 
efforts. However, other independent variable categories, such 
as material and underway time measures, are complete only for 
combatant ships such as cruisers, destroyers, and frigate. 
This shortfall immediately restricts the scope of ships to 
which any possible conclusions may apply. The database could 
be improved by incorporating the missing values for other ship 
types. 

The percent of time that a ship spends underway was the 
most significant of any independent variable considered. The 
models presented demonstrated for the OPPE that an increase 
in the amount of time that a ship spends underway influences 


the log odds of achieving a desired test score in a positive 
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way. However, it would be inappropriate for decisions makers 
to opt to keep ships underway all the time in an attempt to 
get an above average score. Clearly, a ship must spend some 
amount of time pierside for maintenance and crew rest. This 
concept implies that the effects of underway time should be 
a quadratic instead of a linear function (1i.e., more underway 
time is desirable only to some point and then the ships 
experience diminishing returns). Attempts to fit a quadratic 
function in support of this idea failed. Future work should 
focus in this area since it remains an important issue. 
Additionally, the models failed to show a strong relationship 
between outchop OPPEs and underway time, perhaps due to the 
fact that these ships spend a higher percentage of time 
underway aS a group resulting in smaller differences in amount 
of underway times among ships. 

Material measures affected the exam scores, but to a 
lesser degree. The most interesting discovery was that the 
number of C4 CASREPs which begin in the six months prior to 
an outchop OPPE has a positive effect on achieving a desired 
score. Again, perhaps, this is a result of an attempt by 
ship's force personnel to prompt the supply system to expedite 
required parts. Material measures have even less impact on 
LOE scores, due in part to the fact that when a ship enters 
an extended maintenance period, the casualty reporting rules 


are relaxed. 
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As previously noted, CASREP variables, as they appear in 
the database, reflect degradations throughout the entire ship. 
Consequently, equipment failures in departments other than 
engineering inflate all the CASREP variables considered. 
Since casualty reports specify the equipment failure and 
cognizant department, the CASREP variables can be categorized 
by department. CNA already breaks down manpower variables by 
department in the database in an attempt to measure events 
more precisely. Future work examining the impact of material 
status engineering scores would benefit by having the same 
level of detail available for material measures. 

Manpower measures also affected exam scores, but again to 
a lesser degree than anticipated. The models constructed 
indicate that a reduced rate of crew turnover and a higher 
level of crew manning is deSirable in the months prior to the 
exam. In general, the rate of crew turnover waS a more 
Significant influence than the level of manning of the ship. 

Other factors not examined may be influencing the exam 
results. For instance, the type or age of the propulsion 
plant may also influence the exam results. Perhaps the time 
of the year also affects the exam outcome. These and other 
possible input factors are areas for future research. 

The focus of the analysis was to comfirm existing 
hypotheses between various input factors and exam scores. 


This thesis does not try to measure how well the models 
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presented would perform in predicting exam performance. Such 
an effort would require reliance upon some sort of correlation 


coefficient, or r*. An unambiguous, uniformly-agreed-to r 


2 
measure has not been developed for multinomial logit models. 

In summary, the thesis confirmed relationships between 
independent input factors and dependent exam scores. The 
relationships were significant to a lesser degree than 
anticipated. The most prominent was the positive relationship 
between underway time and the log odds of achieving a 
successful test score. Yet, attempts to capture the effects 


of diminishing marginal returns were not’ satisfactory. 


Further work is needed to model these effects. 


46 


LIST OF REFERENCES 


Center for Naval Analyses, Letter to Commander Naval 
Surface Forces, U.S. Atlantic Fleet 85-0314, OPPE Pass 
Rates, by L. Cavalluzzo, 15 February 1985. 





Center for Naval Analyses Research Memorandum 86-123, 


OPTEMPO and Ship Readiness, by L. Cavalluzzo, OD. 
Follmann, and A. Marcus, June 1986. 


Center for Naval Analyses, Readiness Data (Set) Abstract, 
1986. 


Naval Postgraduate School Master's Thesis, Modelling DD- 
963 Class Material Readiness, by J. Will, September 1988. 


Judge, G.C., and others, The Theory and Practice of 
Econometrics, John Wiley and Sons, 1985. 


Maddala, G.S., Introduction to Econometrics, MacMillan 
Publishing Company, 1988. 


Rand Corporation, Univariate and Multivariate Log-Linear 
and Logistic Models, by M. Nerlove and S. J. Press, 


December, 1973. 


Maddala, G.S., Limited-Dependent and Qualitative Variables 


in Econometrics, Cambridge University Press, 1983. 


47 


INITIAL DISTRIBUTION LIST 


Defense Techinical Center 
Cameron Station 
Alexandria, VA 22304-6145 


Library Code 0142 
Naval Postgraduate School 
Monterey, CA 93943-5002 


Chief of Naval Operations (OP-813) 
Attn: CDR W. L. Shephard, Jr., USN 
Navy Department 

Washington, DC 20350-2000 


Commander in Chief, Atlantic Fleet 
CINCLANTFLT PEB 

U.S. Atlantic Fleet 

Norfolk, VA 23511 


Center for Naval Analyses 
Attn: Dr. Quester 

4401 Ford Avenue 

Post Office Box 16268 
Alexandria, VA 22302 


Superintendent 

Attn: Prof. Boger (Code 54Bo) 
Naval Postgraduate School 
Monterey, CA 93943-5100 


Superintendent 

Attn: Prof. Johnson (Code 55Jo) 
Naval Postgraduate School 
Monterey, CA 93943-5000 


Chief of Naval Operations (OP-814) 
ATTN: LT Thomas J. Nolen, USN 
Navy Department 

Washington, DC 20350-2000 


Operations Analysis Program 
Code 30 

Naval Postgraduate School 
Monterey, CA 93943-5000 


No. Copies 


2 











Thesis 
N8425 
Cra 


Nolen 


Isolation of important 
input factors in the per- 
formance of Operational 
Propulsion Plant Exams 
(OPPE) “mid Light Off 
Exams (LOB) for Atlantic 
Fleet ships. 



















[Seles RE SS ogo Nr atce deta ty baciebac foe we. Ray ins uae Certegy eat ‘ , : 8 lane? . Seat ne 
Sepia Sea ne RO nN a so lated) of naam input factors in | _ 3 

Sy SAF ae Ah aes) fone NS peat GS Gre , ie ' é oS 
SAa dH p-dyc td ross 27a Pw Ait i * oe 1) 3 y | | | | | | i | | [ | | ' ' F ‘ pap | 
ty OC Cu Ay SE De lie a “f Sos + ike ae + Hi Hl HII i | | ; " < ae Paty 
’ eee ry see a. ae an nee ae Stroh ne Doane? at ie Wa e iH | fi } | | 1] “_s a : > i 
eat a a Seen Cae nen Bt Coat ATAU HI) |) WA Ml | | ae 
es see reat ne  oneene 3 te <# LAs ta Aah, f tiga & WaT | HBBIE SH || I | i| || tH iH | | | | | - oe ; pan ae ie ve 
taahe ryt each See a Seat eee RS "3 276 My? : ; a es : *, Be. 
ax =. Pe by J . : é “ 
p= hg ey pat a Se si! fT age ~ Shred Sasa: ae Mg | ; ; ‘ ‘ ba 
eh eee ane ere 8 000 86391 4 ae oe 

artes De ph retiree aN E FW 1S'8 235-8 Me < b 





ST Te OS Pe Rect DUDLEY KNOX LIBRARY 5 aot ee ea :_ @ 

aoe Geasiit iw Sox. * eee: 3 us . — q j i : . F 
See by Nett racomna alte Vr rey i shires , 
. RR A hd bins 2 OPING Bauer 32st [U6 hia pe 










ot dad sh Sel Reh OTR & 
yeas, 183 or ae ise Sa neat oF pean Sef a S98 Suite: Fae 
2 ee Rod2 Age Bde ecw f-93 , Ran a4 ‘gk wdee' . 
wz PLAYERS iat nb $0 c® Lf yehia ede \ aT nt taes: hie eat se m 
2 Sh (Cae Se eee ss bade! res! $40 ¥ ‘ Se tdiben i te “s 
ae! Eriirp We 218 mia =o MS 2; see Mah ‘g" is ie a 
Rie eect BS beh yheso on ti i ae. Cy 
oe TE WTA SAe SIS Spaces cg aE PY dr &. whee 
ah Sree +: Ear Aviat, Zierhpa is waa aen Ls ‘SAA 3 tala 
OIG K, 6m avata.ats Ne Fin af pga Vie Ck 
, wa Sar om ohs epee Pre Tews yy aby Bara by 
ore ree Steet abated Baas , ney is se Pipi toy were ai wn ay 
CAP fem. ahh, Tio Med jects ta cai it 8 ascii sist vd LPMA ore Deh! 1, oh Fay 
af oar erate oi A rT Sasgion PAN preys de oa ae x’ £m £26.4- 
aan mre N TS hl ee fa ests? ey teenth Dyehviet’. we Shs Sith eg eta ais fee Sip te 
eoreey vert ee ts Ae TAY Flies: 5 “wilt dy one iS ahs Ao Rea PME a 8b rm del gel at 
Seas Sa MAT — int ahi bs ae Rrkiovd¥: hudcedaw hy) 5-8, 25 De: 38 ASS 8 49,2 
pe: ihe & hy ee ae Ao 
 absaserds aye. 8 
¢ 5 
ar tenet rans wine 2.S Spy! per he vier hy 
CRO! pas Saba 24 o Fe cot ER pore et Seti - PS “yh BRE ophe 
meres nea oneness "Een. ree Re y ek altro 2 Mas. pha s la ege tits o “ytd hi 


arspiptes ee entoans Sarcal Irrreamn be i eg. 1) Be Be Ry Rk Ba PATA Daas te 9 8 gee jat ts 
*. - Teh iss Py ee! Heise eiteze: K7ee Me kdale re wir URL Red oe! Fa Msi esa'ree | 
see Avy Toa : Aelia Py dod! ee Leg - PLS ii geek phe Z Ash “var 4 Sack Dox gree 
‘ Ticesan Seteni bates eg y] Cie ory A Sars on Lhe oar Deh VA 0 TAT. a wl, Re S34 
ms tp aaa Keng Sob HAN hE et rs ee ths ot Le ot wr Au ve tsps 
ies Ne pnt bs alent Aen Sa Spike! siies Si mitch aAprg pAb. 45 ae 7 Oe Ny auep CS 
Stirs CSc Gis Es. Ae ve aie. hm 418 tae B “Hike wa Wrelvee a f $e o's ay x 
. Romeo pete; os tone yr Pere Robot aa a ‘em a ; oy ¢ soy RS wed 2 = ~*f. L sare ™ as 
te Poe a bees os Mea} me rt; mali = oT oak Bb *; Raw 
5 ot Seer ioe Aakash! Gis mene eran Nei lte F wi Arent Fito te Lee dtd MW Dard ps, t a fm gutt® 
None ep ati pao) iS R Kemah latest: FeeK eS SAE itr 9 Se an We ea oo Okt JO. te be Fergie 
Sam Boden bt Z:45 "as Ts 


no! de. arab a ada Io ONS Arita yor) Py om +) TRA a rhens thon o> he Fel P MAL A 
ex Sets Sore 3 as SG Sits ae hogan ae tise 
a apt Hel tae os 8A - A} o* s 4 7 
r% ctpa-tenve-den ata ae Maes ef i She. Sy ee.y! ‘se Ay z 


ete heb pred aoe peared: ‘ene De PRE j 
5? =< a <> Abn iy bap F rea > aids . - jaa . at " agtke 
ddd 2 Cate pd SOAs Ae edad £84 weit Set o> Paid Paes “$e if ani Shee RSA ae ens 
Pi SeSUS a a habe vere iy sep ettaNet at tg | 


a . maeepnt i Base ae ase 
Cin zy heaae jhe. mere 
es ee Saya ts woke a8, 


' 
1 
egies So ae Rae eens tiae prechearerceanie ot ey aesber sete | 
bad eee = ot be : AP rears ar A NA TVA Br AR Soh Wai ota at! foe wih ye 
pa”) very Sian Sora a ey: ies and ae nye wa * ae a eb, aia® gu? i Ye s' Te 7 Aq tt te gt 
posted Sates we) al Zr eaters Epes ee wand pda Ni aed AttnA abst rh “pe *baltme Gye o ee E 
Fi pdiyy*% irs eo ee: Sroact 7 Sy pata, (ro QAR ae Mg aie Those har § 
crm) ae isnt ones Pa rst: Wut poeesrip Le rs BRr Reboy Ws. fet se abl 
whe +e ity) Qe: ew, eh! Lanter ede Oak ere” Pata cow pai" Rey 4 
fies TPO BAS QA FT 2189s MA Sen ek eS ietin ey ie rx ret ss 
reat DY STHAT We i falw ho att o® St pFp Sieh 
abi\ay ies i: Pies a} ieee Me . at pe, fie 4) Hy . 
4 ee " Say ry wigin tn "Sl g pt a Ae ene col wit pyGhe. bya heya 4 
sheen oh PAALBA Pe ONAL AEA oh RTT e a Dee) # fete e ap 
> ‘ ad Rect Eo rls h: DISISS ip. 2° akaNAS $ pat tiw.2 ed uy Ss #) 6 08k aete y's 
ua all eat nie Spats, fee. woh: S ah vores beat PBL ERIE 208! a) op sca ete Al) Sekt art +8 ya! bd 
panes at megue asa itiang op 



























Se ¥F i 



































‘ we Mheegy- ied vt dees 
e nos i “one po autat 
datehat “ytite D a de o «4° tower ‘ts i wee ont ee he AN og ‘ 
ne h ee oe gp TES A gi Mare p gt ts 10h Coe ot gh ow Me Oa Git eka ap alt tee 5 4° 
mo. oe 5 fetta es B® e Stet Pad Le 4 '% ty ae 
Lue ian 4 ST a Steg eo &® an Star “ ¥ oo 5 
ie® nett Sar Me 88g bd te 
4 . Ri ne bs Kee esge, e a 
au etrgn Pera; «,9 8 
\ Ste ghee phe 8g 
F Owed 8 ogre? wd : : Higgins woe og tis ° 
MY ayer 
He eu. at ‘ i 
PA ne ar ae Sa a ad ta 1 " 
;? 2 


























A eee! tebe Phy An H cs 

a aioe . id i ew 
eh : SFA. ae f° deth ; 
. she 








‘eps 
re tinea La ad 

put oes 

sae on Bates ad hd ; HY 
‘ bo Sad. bd "Ry as tw * 

Pete ‘3 ae € DAP q pote 

Byen rb geaetent SHY gestae 8 ieee, 

nek e Fy > Ser tep) sa Soreed vt s 
> te ? 


F) ~ 34a aM: 3 9% eo SE ONG ae, 
Mx. oh tans Beenie a 












ate 

























He SPYaka PRS ez Pehla Ueosegs Age Gg! 
ay as £3 doe eee ~ ES he a a San i rmebSaoe SUT Sutyr as of 
<i ayant ne wie'E Spl el teyi* ey a “Nees 
me eat ee 7 ps of hivat te o syatenes ss PAF Sr e%a! 
a he AR Riot io é nurse Wo! phe etd eas} Sete! Se 
ah Fenn dtd 1 ‘ Py 5 fers ahah 4 
Nod WW Se 03 3h 40h +a "¢ 
sinless on ‘¢ Bik Sapa Mp Sait ath “As rhe a 
Lahr, a Hon a de REET ar RO E's whe asses AAs 10 bsceh ae a 
Deh On Nibee Bika ot BAD bighe oo Mabe Be 4 RaSaEy: Webs als ee 
i petreoehd: authei?s a, eget bos Be % tone i ee 3% wei Be 
eS Ste BUS be cede! rat b idk ratioaee eed SSG eat 
. tide! or haat ag? bs ite teh 
+3 stele 
neal tds x Sethe hg 
Stars itis, rey 
rere ore BMals othe wid 
Speers Para i giet® 
3 Par; SERA Si yn? ont Pee NS Lo 










































RA ALIA 926, 
Sei as 350 
; wea! ay At 















Pye 5 Y. ke Fe . > is fet 2 
re are "SX Ss Ss eyes AN Sah ote 
* TS ee i RS: ieee igh iy ix cy} 
ote eink? Wa ark fa aea"s HA 4 F % ‘ard evans ah gta 















eral 
a%e8 ted ofsers™ 3A 
Opry bat eha Set 

Babes & ‘ 


























30 
o> 
»# 
et 















a: take Whrsy Dar SE98, RY] a 
Bea Rete eiR: gmake ahpeiy a Gor ane wate eeny 
eae eer! ree ae ’ 
4 ee nS 4 r ‘ 
hh e ¢ ra ear, j Part fj 
ie Ser tss Oe 
FEA Bak 3 SS: Aryade edi mans 
ASM me aoe, Pamuk stakes) ANE Ho WE RA ba S NY Ee 
NOME SERGI TE YE gh MeL TRIS AS BS epak Sn! Pete doy be ete 



























o: i’s f 

VES seek the ae, 

§ 38 Sareh Sepa’ Ww 
» 
























eae Py ds ope sey eyiats Wipeae sukds “Jereee ye 
Ye 
a ay rier tN Sp rabey ea vi 3s sabe 
% yf FPA oo 388 are Pp ary a> 'e* 
; % igh 
“ayer ee Fe re) hele eke ey o ib at 
" yeh of + <4 eee dy’ witb? s on BSS sys * 3 


nf 
Chas ated BSR idee" . vit te wal? 2 HOS LATA vag 
Siete oat" Mr MEAS i Ee he ho Bet th kee 
Seek HS aREN Rea ae sa f 
eae a Sysetherds A ap ORaNd eRt Ser Danita Het tins 
Sits " “. es 
% At “Rot ae 8. Neh * an 
eee hed 


? a Woy + Pe) Ph Latlid O erie ge 
Ff wl SPaayty et gee Pe via : 
2%. awe iy atk. Sh Oe bh 4 

so be'S isralaek 






ii ie ay ars 
43 nae bul ; Sie “3° 257, 
ae pce My Meena ane 
fps “Ss i: 
Boa beteh dite eyed shape Ny 3 Vern Veni enh re as iN 
Phas aa ae da caf senk aan Ne, b= PITY & P28 is “ 
UA Rat paie ES wee DUPRE Naas 
ee Oe 4 2 aed CTA 
ees tc ity yoda Se Sayk A teeth rakes RING 
4 Neb yes “amar dy > rr 
Fe as ns) a4 bahay rea a 
OS ABE > soins ene 
rye ares FE ae 
Rea Te i, ane weed . 
ete * # 
: Ssh a AE! th ies Ph PPL bh is Bs 
“3 Bi Be $4 Varig PY + Barb ay sib EADS EAE EADS, 
eee Sele artes, ah SSF Rie Netg ees Tag 
eres 4 a he Lat eo 


wy are a: aris 

SS3UVebee Bd«, 
ee ae i ain i? 
: hls ee mate peu? pees Ret 


me hed ree 
iy ree, 


fe “ ‘ vials st 
End ace ec 
$4 a ENN, ee RRS ER Tn, 


sy, 


See aan ae M435 So oR EN “hy 
? Ae 
Benne enna sen 
: i 


xh 
























af ares. 3 
ry a i Fas ght Ot 
SL te ae 










SoM sre vb 
SBE ASSL ane tecies 
Esti 

ee hay «™, Spa 
pe 828 Sd ene shops mas 









































i 

© Fs esate ‘ folate 
dei) het, feats at 

© Wete a nine eat Me 


Se yt op 
"eats oe Sg hdey. 
a Sg weet, “e q Bene 








. t 1 
Vy thames $15 oe) a, ted Sp ye? 
foil ‘a MA oF heh areh « 
2 "eS ¥stf wm hh oye : 
wr a 4 * CP 7 Fist! 
we o3th2 Fh fy, ond a fyivd 4. {= . 8 
; se has eee cA ee Lat pies 
“© te wa ey hae SH fecal Sgt pty ts," * 
at eer jek! vated here PL rr a arty; é ah, & 
Venip ae: SAYS NS 









¥ % 4 Lait Y sh) '. & » oer Cue eae e 































. "aN Bete SN gieyh 
a 7% o" nese tdhes whet te a 
t 





one 
 yaResd eae Pht rit Ve Ae ye 
Sey? Parise dent $e? TAN aa eof ips +f Sie wes Neegn adhe“, 
VRnsy any a rere te ae ~ er 1a + van Hi meh eg dyels “hs 8 ve aly 
Fos Be ae SEP Soe “yys Tytavagk We Ast RPE Ae MERTON EON Mi byl, Hei e 
ry art) 8 ALi ea He Shy y wine Sa poe 330 83d yeh Pog 
aga Data Ale Lea Lond Se Ps PPS) Sar Dn Ses 
Fy ee} aya esr Yih fae Ve v 1 

fo "eats be f8<. 
Rote "a 4 * BY 
OPC fa Parse: 






















| Eo 4 
ryur> " 4%, H i e 
rou est coh ih; pin 







on SA yee ety ey &% rah 4) 
— “oat 
eee ects We 
wt; 










nt, BAP rs Bost ) 
a se teMsyah awe Bletaing | oy 
Metis The et AM penRE LENA OT® tty 
Ye We fier: yee wv spehe, ut Fae * oh" 456 
oe Lien) yeaah ane’ Lad p EAP) ot ik ® 
: CAS isfy MP aed oops Neetaee Vere td 
isdeia sis ease Rebate ti SURAT sare as 
se Tees sae n Brahe Ara Dion nee . toe £0, PES HF0 ab sotgy PRINS THES sate gy t a est a 
Sake = $974 157) MUS Cine, GF oe, 1 Yeh ri Meret, eg Ba) 
— mame sg def iv. abieeel. AREY: WANES, UESSE DUT PM Sh ary fete G8 ehy wtyi woe 
", as wrk nal Je Se PS, Be asl IK i epate peRomBOr Us WII Ge Bow bay as * A . 
ve Puna gerard hh 70 eats Gly 2a Pusan ep Lidas stv. titent ya “ata eh! 
ay Fe NIT ye toot Rat + wet airs Rey oye is A Nye ite See seenie Nye iste 
es : Ente 15. As & are meee ee wie ds Byes SX! 4 rg ‘4 obey’ Pgidnt gs ht rare nae 1ae 
Sriats ay re wean ese yet AK, ope “4 ave p. gehy ‘ng av up re Oe Ys Uh ‘ s 
ses ats iS oh eg baresr ey pe eits Frye he hae Eb DIR ALS Shieh phd saps uy it eT oo N81 iets i 
pads weg oents pene Py 4 200 v BIN ea AES 9.d78. 9 Bs the ale te Se eR ek ee a 


cared Lg ¥ galt om > 4 oe te 
< Se Bene Ree ‘tte Mer Sun % Benya 
= eee ecto ie 


UA ae | 
PUR beietied Hy 500, 
yay PAL i ii ae st 7 4.! ei 
Resa PY an 
move 2 at thy . 8 ; 
aes es 1S Yay! ans { : * ee 
5 . ‘ ae 


Gye an ua,4 
49 5 4 S iansties ’ 







Lars srs on 





a 
Sorel’ 
4 






























Bicotet ets 8e% fot ’ 
feb, o Shese¥.d oat aq 











A ’ 
tie \ fee 
Oe a getgl b ¢ o et 








Ps i ee MP te ty 

atpyrtes S* ses 
Lh gta gh 2 ae ha’ 
%-% is . 734 










































a agen 





_- 





ere 






















eek 
om t bsatce UXcaeinig iv. testa 














ralyoot hh L Of 7 
US EM ely Ney we tye 

ese woe ON Wien “aul 
Ret Wb oe 8 aely tote 
May ww Wee wpe tet ated OME Ron 
tee ate ae awk ‘ “ 











my ae we a Sek Ee at a, $8 sions 4 z9 G 5 
Cpe Ys Say ae Pm 3¢ Yolen bt eer aah ust! cleat Vibes SiC We hay i i Fe in a, res ‘ rik °y 
2 HY S Wa Bah a YAP Zot saps Ducati sibel ei eeyosaye HAS Ornate eas oe ute fo 
te th Mataeetort 2 4a Aare ean aS ets: 4 ye es Ny. fe. aime ib ¥ : : ge URED Y vege MT wey 
Saeed! 3 tes gia) bead aN. MPuVey ® ste Awe f ay, * ? SeeE STP EPP ES ONS Le og 
oy pee fyeeh: Fide Sop ss m8 5 mhie sen ehs *: *; aM Wels cred tv edhe aceite acshe vss 
more Md - ant ¥; Ss ty te oy ¥°, “Ghee wit rer ae 
>" Total ee ¢ ye gh’ i ie. ba aks PUY Seer a Meni ges rset oo eee RSME ae * Uae were sendin vt Da 4 it Or ie 
os be a ett Soy Poe 58 LEDS, fen ee sae le aby Reg wala ae Se be foorle a 
ie be eng op Ae J eho Pade Pama on te be OVI ork op. . oan ed y.aF A'ey@ «A eer be ‘: Vie. ' a w bp 
es we ois! paaiats: 1 eady” ap py Ree oY) vay TAT) to ae Vie thy’ : 
SN 0 aay -ae Sih aut’ ‘ony he “Vek, tigi gs Peon’ eit, Spee, KAR ENPh Ries 32 o3 “aoa aes shea dle it 
Ee aioe Sree earyeae 2 aN Fe eae yan , w Faye 44 toh ay TS of Ce é rs 2s! AN eth fe pk 
dyna) Bre ats =" a rh yet Lo oh ts fete abn us PrP Vadee Lie est, Welt: perky ye Ode saet 
xe gh ik ayser ah ce Sey ef Feito) er ay way ie mPaegsys tm & RIAEER sist Sg ia Hai § y 
ecg fe i Rew yieh wets Je Sarees ve AKAD aaa wee Sy HAV G Msi: ws bagi oa witys ‘ 
st Say a aly Seta a buy, By beech Bx Pah wee beets we Gay We Re. AS be ys by tue H H 
Spates siege on yee ihn RR fa Ree ay Se ty iw aS oye 8,0 8, hs omy do, tN, - . at 
owe neers: Lage ® inne: atl cea TAYE wastes yen ful Aer LP ath od ub tort «pve hoo oo ie aoe \ ey 
me 0 woul yr 4 melee te at v's, seal darts, yay ge we Tepl Mtg ley’M ay, ue. gE” Tet! yes CPS a Ce oe ‘ 
See sad ah a ap Seley iy ae Voie Ue che Ww) aby § a: confy: Pe ee Ca i ’ i 5 pie Ae NT anes hes 
oy ta! pat Led ad ry. * eriabe elegesie i yio'y he’ SREY LS a} OT "9, Ret 47g ¥ ma, "ae be . ee or een 4 ‘ye hye ed wh sigh & pee ow 
apes Ae pati om #,' aA Hes yoru ae 4) yey. By As & vith Py § pape tkerbatlvey 1 At usb ALANS) _ , ahelaygh,* § oh 
tyr Jokes < sotyre w-& fe eA Henge im ona os : 
Speer ie "Ee seyem waa Pater e bob SP ubitlpepmecolzareras ao. at ify ok iA 
et _ * Ye ‘ yh pF Aas el Ay Ty boy. tre sgn ft Met ut unauies yrart. | wi, ¢ 
” wae ayia’ ®, to ihe eine ath wp © 1s he 
arg iq aivie i einige a aes ule ypelyiee, Gia sayeas ae IG eget vyvsers vr aay Tyndd Site 
nee erat BA8% tui Sebe! ynyee 1, et ney) aparhee TE IRL A AT, A La bas us roa a eee, we 
parse + ines Me I 2 xa wraty Ov PLEA, eee CS Yeti baer) iiaee 13h, sw rele od 
Be tteaeat 
oy 





re ad “Yi s ad 817g) Ue » nig a mite oe sasitard hye & pay Pate Be Holl gem Ke 
a es 
speMipniyseshow vk, enya gt Bey HES Nd fg ed boas tab gt 
st de 
20% es OTS WPe ARS poe ren ofp vase yatta 4 / Mu atta’ au f Phe ‘ yeep 1 
seu weet is a 6 ar *e 










yes mtn Tad iat] WS 1 bet x Gor a8 wadtat ey Josie eMtt ar NY 6g> ° 2 Ing OSC, Ta 
nz “Ai9 a fou tieyy"e erene aha bie . peinypyreze “ee ae aad ree f 3 # To Reese HE fue ey Me sy ; 
%. EtG aura, vik &e,* git aa ea! shee WOT Bebe Jere ® & p gh rgie o tle jtedy, ‘ bas? ¥ ¥ie, Wei ls gout A i ee Se ' 
oar soaps he tev why iy aw eo & Jose Pere} J ries *¥ on . tue dntepe: i 
TOs i) cr Newari thy rig Bee peyy sb ey {APE ro Wey a wi Fy “by ft oe 
oh aera ¢ £8 %& btig yin pots & “Asbo oye "whee a wma et tare. ete 
rth ds ba iy ‘my an yi web py Ao Ber ¢ PCE Ald hts ot sae ates <a ° li 
cathret ee * bi ened e ¢ 4: b@e SWS bea ede se i 
nee Pataty ritait sah aye : ih 
Abies 4 cot ‘ere a ere a tee our ' mea 8 . sey me ae yeh e Ware 
rt ee SIL ar ind, Sed aes De ba wt 0 Ae : 
anes vp Nee 0 Bey paribes, wih: vty Nhe & ot 
tan oi ede & 8 s — Fay vie" 
"R' ese 


ees cad Raia sah Reha on AD YH anata ar 8h) PG 


















om ere 
ee as "Ae 1° 
fe lee: nen 


oak cee: 






gs es sveele, ital fe ok ea ae 





ra ye ro un wag, ye vik. ve > 


a rata th ‘ ; 
genie te rm "aget ahih ud fy 4st tt fi we ebay 
fet eet eashs ch, f} CH 34 ut a oh © iE , Pi ela, : 
Ge epee alee qa fe bea. eS te 
' hoy v.4 ' 





« 
oe 
- 
sg 
c 
—_~ 


> hal ee Pe 5 are at ; fs 

? eve ert eres pao AS maser 4 * ates oreo te: 4y ran at: (4 ty ve 

reek tongtick: 9 20)%, ‘ye pra al ine " tomate 9.3 “ia poh ll Fal é ‘aid yin ae desi) s w.\ eb aranr is yw 
: le S123) 


* (aT ° } y 
"ot or Ch : d r,t Dole Tie {Vy be Ae, 
eae ES en gece’ eb maitre katy apes 


Get talek yk ote: "4 vat Chet "SE bog Ke bgt tt 
¥ fer Ce a ee, " ey oremel fakge dy’ oe as a hey ” Outs her) 

ijn “2 29 024) MPa Pale’. Ra Reae * 4 Oe trey ¥ v9 «? . F 

ere seen at {4 dy * hg 

hr ae hs wig 

a 


ys yep rrery. ode stent *1Wi 9 oe? Ab dung! rete yee fete snunes 
lees ay by MAA ¢ 
te 














ibeir's, ete Wake G i we) af: eu A { S ty Tale vey 
He ae 8 grt piagtn ae <4 1h, ‘Rie 7¢% eae ) #9, u,Jy-t ae. ah Sees gay! : 
Phy Be ct he Ag eer Yr obfy, as Noo gaRt tenet Me rant ne Hated setat Voagids - a 18 a ; 

ste BiPL aby ‘s TY ordi. vay OLY vy Uae a Gee we tte dof my ur pond fy owl y 


meateeen ah er : 
Peay, ry : + day, Mane p oid uy gh > e% WIN; a Au Pay eat Fins 
7m ae e's bg ery b, Neat} dt ry he y me meu 2 a 


wry e' : 
edt se °: WA Taye st eae ire ' meee ty ly ie! a ‘® ro CR RY A That oe) uw, wné ft v, 708 
vem pb ; 4 ale vhs) eraser eee w GAM e 9, Fri Pha tel hse yt § Vyenty uw. ¥ bP bas thay on Hywel Kee ge te oe OS x 
L i447 : y gleerur® 2° ae figh PU be meen) 7) +t te ving) yite 5 i eh bf bel ele ia Opa my ghee Vi wy wg. Fim ow Nh 
a om oe ue ae yrre' + ae Price. ais - y's Us bag | AY Nee Sek a Tie hunke mVperh 06, bye, if y Ee ee ee 

or wis es AIO ere wre a Rte, wikis ne ‘ eis 0 Ghee GS shot ge fare i. A eee : 
Paya ee Tags no LaNeR: bere tes eet RAK ‘ately: hie bi preys ¢ aka? yy i oMFt vars Gok} hom gt i, ¥ a. 
scoresuser? red ‘nad Md Rent ehsoory aa Ay, ray? pms evens y t Re%el 7 it af ’ fv a, ty yy *,% a (ot AY ar a Ss nd te wg, bE! : é 
ae ore cee hy Le paryet ot hi de OA 42929 § Seif A jnys ij o4'e  Vleshyare yo 'f Cat ot nay a0 

4 . e v 7 


wipe, 
aie a m6 Om rey HOt reas NO ate RE ne yore) L Aie sha Se "Ee Pues weo An 
Shes 4 ee ae Aree ra Th siytens ote ve es i Neary, te Se a8 fats: he Ly ee fy ay! we wee ie 
Soe te a 4 there’ Wes eat vy BEYEDE ey patel ery b.6 vents a he wits “eh oer ibids vilere 6 rf yn Fy nee te by os 
Ae > %¢" ei ay leet vagvi ‘ ™ Gan AL “S.foe7 
a, vy Fgh iy ‘ 


rel sii Tots aa 





an 
wee uly Lf, Mou er ny 7 as ' a ; 





















pee 
ap 90 herd 5 





Ans ee ce amt ade he tet dh add py ATP . 
oe 98 3 Fresezy 9 & ase 948) ooh, ah 

i Le Somers > CS yo 3 ON bye Hig) mss HA mints val ya MPS % 

xe ho phlei . a6, eA/e be A vat) ee my iP, ets . a "gin! aM Ay are 
rere O09 4 ia ore te * wets $773 f=) wiety : ts Pe be ne 4 ff 
Seaver Tesh: i ha! hgh yy op! + as itey bee heey ee BD veri? e. ‘es ‘6 ry ° r rw hop “% 
waren me eee we i 7 te BIRT Oe Ae wroepay" mice were RPE «tye ft et 
steve to's eee wet'ar, tsar ; CHRD HVE FSR VWAhery YArTe > “6:4.0% we 

ie ae Pee = 5 | 


ee ee he dy Seb at nah Tein a, Sooner einem tate we Rha ht 4 yt haf Biase Ek rolety ey 


. 
- 
. 
‘ 
w7eor 





~s <.” ). .~ ee 





